Clinical Relation Extraction with Deep Learning
نویسندگان
چکیده
Relations between medical concepts convey meaningful medical knowledge and patients’ health information. Relation extraction on Clinical texts is an important task of information extraction in clinical domain, and is the key step of building medical knowledge graph. In this research, the task of relation extraction is based on the task of concept recognition and is implemented as relation classification by the adoption of a CRF model. The proposed CRF-powered classification model depends on features of context of concepts. To remedy the problem of word sparsity, a deep learning model is applied for features optimization by the employment of auto encoder and sparsity limitation. The proposed model is validated on the data set of I2B2 2010. The experiments give the evidence that the proposed model is effective and the method of features optimization with the deep learning model shows the great potential.
منابع مشابه
A Survey of Deep Learning Methods for Relation Extraction
Relation Extraction is an important subtask of Information Extraction which has the potential of employing deep learning (DL) models with the creation of large datasets using distant supervision. In this review, we compare the contributions and pitfalls of the various DL models that have been used for the task, to help guide the path ahead.
متن کاملDeep Residual Learning for Weakly-Supervised Relation Extraction
Deep residual learning (ResNet) (He et al., 2016) is a new method for training very deep neural networks using identity mapping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-theart performances in many computer vision tasks. However, the effect of residual learning on noisy natural language processing tasks is still not well underst...
متن کاملUnsupervised Pre-training With Seq2Seq Reconstruction Loss for Deep Relation Extraction Models
Relation extraction models based on deep learning have been attracting a lot of attention recently. Little research is carried out to reduce their need of labeled training data. In this work, we propose an unsupervised pre-training method based on the sequence-to-sequence model for deep relation extraction models. The pre-trained models need only half or even less training data to achieve equiv...
متن کاملOn the Recursive Neural Networks for Relation Extraction and Entity Recognition
Recently there has been a surge of interest in neural architectures for complex structured learning tasks. Along this track, we are addressing the supervised task of relation extraction and named-entity recognition via recursive neural structures and deep unsupervised feature learning. Our models are inspired by several recent works in deep learning for natural language. We have extended the pr...
متن کاملJoint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning
We use both reinforcement learning and deep learning to simultaneously extract entities and relations from unstructured texts. For reinforcement learning, we model the task as a two-step decision process. Deep learning is used to automatically capture the most important information from unstructured texts, which represent the state in the decision process. By designing the reward function per s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016